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,  Introduction 

This  paper  has  the  objective  of  defining  the  relationship  between 
handling  qualities  and  pilot  stress  and  workload.  The  reasons  under¬ 
lying  the  importance  of  pilot  workload  measurement  are  discussed  end  ways 
to  analyse  or  treat  pilot  vehicle  systems  are  reviewed.  The  varioua 
measures  of  pilot  workload  that  have  been  used  or  considered  are  dis¬ 
cussed  and  some  new  data  on  the  possible  use  of  pupil  dilation  as  a 
measure  of  stress  are  presented. 

The  pilot  of  a  flight  vehicle  performs  a  range  of  taoks  and  combina¬ 
tions  of  tasks  between  take  off  and  landing.  These  run  a  gamut  from 
the  most  simple  to  those  single  or  multiple  axis  tasks  that  may  tax  hie 
capabilities  to  the  limit.  In  preparation  for  the  flight,  certain 
planning  and  evaluation  functions  are  performed  by  the  pilot.  In  take 
off  and  in  other  phases  of  flight  such  as  formation  flying,  terrain 
avoidance,  rough  air  situations,  gunnery  runs,  and  approach  and  landing, 
the  pilot  performs  as  a  precision  tracker.  The  difficulty  of  his 
tracking  task  obviously  varies  widely  as  a  function  of  the  basic  dynamics 
of  his  vehicle  at  the  time,  the  condition  or  availability  of  any  augmen¬ 
tation  system  or  display  aids,  and  the  disturbing  inputs.  The  pilot 
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devotes  as  much  effort  to  these  tracking  tasks  as  he  feels  necessary 
for  efficiency  or  safety.  In  difficult  control  or  emergency  situations 
the  pilot  may  regress  to  become  *  single  axis  tracker  and  ignore  other 
control  axe9  or  piloting  functions  that  are  less  demanding. 

During  the  cruise  phase  of  flight  the  pilot  becomes  in  many  cases 
a  monitor  and  decision  maker.  It  is  clear  that,  in  general,  the  pilot 
operates  in  a  sampling  manner,  collecting  information  on  various  situa¬ 
tions  in  flight,  evaluating  their  significance,  making  decisions,  and 
taking  action  or  no.,  as  circumstances  require.  In  certain  situations 
such  as  engine  or  stability  augmentation  failure,  the  pilot  may  call  on 
a  repertoire  of  learned  behavior  that  allows  more  rapid  response  to 
these  situations. 

The  pilot  and  the  stability  and  control  engineer  hove,  in  many 
cases,  used  the  term  handling  qualities  to  describe  the  degree  of  piloting 
ease  or  difficulty  over  the  wide  range  of  conditions,  tasks,  and  situa¬ 
tions  that  the  pilot  is  faced  with.  The  pilot  opinion  ratings  collected 
integrate  these  diverse  factors.  It  should  not  be  unexpected  that  these 
ratings  might  vary  over  a  wide  range  unless  conditions  of  the  test  are 
very  carefully  controlled. 

Work  Load  And  Its  Implications 

It  is  well  known  that  in  some  aircraft  and  in  some  flight  conditions 
or  emergencies  that  the  pilot  must  work  to  the  limit  of  his  ability. 

Up  to  this  limit  it  is  also  well  known  that  if  he  desires  he  can  maintain 
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his  performance  of  a  task  even  though  complaining  bitterly,  a  factor 
that  prompted  McRuer  to  refer  to  him  as  the  "Vocal  Adaptive  Controller" 
(Reference  1).  To  a  pilot  the  multiple  stresses  of  flight,  ius  workload, 
are  summarized  „ade  iis  judgment  of  the  handling  qualities. 

The  handling  qualities  engineer  has  endeavored  to  find  a  more 
analytical  approach  to  specification  of  pilot  workload  and  to  correlate 
the  pilot  opinion  rating  with  such  an  approach.  The  critical  tusk 
philosophy,  Reference  2,  offers  promises  of  at  least  bounding  the  limits 
of  the  problem. 

The  psychologists  have,  in  general,  taken  a  more  academic  approach 
to  the  problem,  Experiments  have  been  run  with  various  side  tasks  and 
problem  solving  situations.  Many  of  the  experiments  offer  relatively 
little  realism  to  the  actual  flight  situation  and  the  piloting  Job. 
Consequently  much  of  this  work  has  had  limited  application  to  practical 
system  design  other  than  in  establishing  trends  or  limits. 

If  a  reliable  method  were  available  to  obtain  a  measure  of  workload 
or  stress,  it  ia  undoubtedly  true  that  many  of  the  anomalies  in  handling 
qualities  data  could  be  explained.  As  an  example,  Reference  3  reports 
combat  tracking  errors  three  or  four  times  greater  than  those  obtained 
under  otherwise  identical  tracking  tasks  in  tost  conditions.  The 
implications  on  criteria  for  the  design  of  new  aircraft,  their  control 
systems  and  their  display  instrumentation  are  obvious.  The  systems 
could  be  designed  analytically  or  tested  under  realistic  simulation 
conditions,  The  design  could  provide  a  reasonable  safety  margin  in 
pilot  workload  and  yet  take  advantage  of  his  capabilities  where  these 
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aro  available  and  may  aava  some  weight  and  cost  in  the  aircraf*,  improve 
reliability  or  maintainability,  etc.  And  yet  this  capability  of 
measuring,  and  understanding  overall  pilot  workload  and  thereby  being 
able  to  utilize  this  knowledge  in  vehicle  design  continues  to  elude  us. 

Wavs  to  Analyze  or  Treat  Systems 

The  design  of  the  cockpit  display  system  in  tho  past  has  been 
heavily  intuitive  with  great  reliance  placed  on  simulation  U3ing  a  "cut 
and  try"  approuch.  To  attempt  to  put  the  display  design  process  on  a 
more  rational  basis  a  methodology  has  been  evolved.  Reference  4  outlines 
a  set  of  procedures  which  is  often  called  time  line  analysis,  although 
the  complete  methodology  involves  more  than  time  line  analysis,  per  ee. 
Figure  1  taken  from  Reference  4  illustrates  he  process.  Figure  2 
illustrates  a  typical  time  line  assignment  chart  with  allocation  of 
tasks  to  the  crew  members  or  the  machine  on  a  second  by  second  or  minute 
by  minute  basis  as  required.  The  process  of  determining  the  human 
workload  under  this  procedure  involves  many  email  judgments  and 
probably  represents  a  considerable  improvement  over  a  broad  intuitive 
decision  or  a  "cut  and  try"  simulation.  Once  preliminary  time  line 
charts  arc  drawn  and  problem  aroas  isolated,  the  process  con  be  iterated 
with  finer  detail  if  necessary. 

Another  relatively  new  approach  to  flight  control  system  analysis 
is  the  dynamic  analysis  of  the  pilot  and  the  combined  aircraft-autopilot 
system.  The  resulting  pilot-vehicle  system  can  then  be  evaluated  with 
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respsct  to  ths  adequacy  of  the  airframe,  or  airframe-autopilot,  dynaoilca 
for  specific  flight  conditions.  This  approach,  of  course,  requires  the 
definition  of  eone  form  of  mathematical  model  of  the  pilot.  This 
subject  Is  covered  in  somewhat  more  detail  in  the  next  section,  but  for 
now  the  point  is  that  pilot-vehicle  analysos  can  be,  and  are  being .made. 
The  general  approach  la  to:  a,  define  and  verify  a  mathematical  model 
of  the  human  operator  for  specific  control  tasks,  b.  define  a  set  of  . 
"adjustment  rules"  that  establish  the  numerical  values  associated  with 
the  pilot  model  for  specific  tasks,  o.  establish  fundamental  pilot 
limitations  that  constrain  the  adjustment  ranges  of  the  model  parameters, 
and  d.  use  all  of  the  previous  to  predict  the  combined  pilot-vehicle 
dynamics?  for  the  specific  task  In  question.  Reference  5  contains  a 
brief  description  of  this  general  approach. 

From  a  practical  standpoint,  the  workload  related  factors  in  this 
general  pilot'-vehiclc  analysis  method  include  the  constraints  on  the 
adjustment  ranges  c£  the  model  parameters.  That  is,  the  task  exceeds 
the  maximum  pilot  capability  (full  workload)  if  control  of  the  airframe- 
autopilot  combination  requires  the  adjustment  of  pilot  model  parameters 
beyond  known  human  limitations.  Therefore,  the  parameter  limitations 
or  constraints  may  be  considered  workload  measurements  in  this  esse, 
and  subsequent  application  via  the  pilot-vehicle  analysis  method  can 
yield:  a.  an  analytical  prediction  of  the  pilot-vehicle  system 
stability,  b.  some  indication  of  closed- loop  system  performance, 
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c.  an  evaluation  o£  the  suitability  of  the  airframe-autopilot  eye  ten, 
and  d.  an  insight  into  the  vehicle-autopilot  dynamic  properties  that 
are  causing  any  problems,  with  attendant  specification  (handling 
qualitios)  implications. 

The  pilot-vehicle  analysis  approach  outlined  above  has  been  extended 

to  a  design  procedure  called  Pilot-Controller  Integration  or  PCI, 

Reference  6.  Thie  procedure  represents  a  nyotemmatic  design  method 

that  considers  control  system  failures  as  well  as  nominal  performance. 

The  procedure  leads  to  a  high  flight-safety  design.  Figure  3  depicts 

the  PCI  process  (from  Reference  6) ,  and  workload  measures  are  used  In 

phases  called  "Failure  Analysis  by  Paper  and  Pencil  Methods"  and 
€ 

"Failure  Analysis  by  Simulation  Methods."  Specifically,  a  workload 
related  measure  is  used  in  an  "additive"  fashion  to  determine  if  manual 
control  under  failed  conditions  is  poesible  (normal  workload  plus  incre- 
mental  workload  due  to  a  system  failure  does  not  exceed  maximum  capability). 
If  a  failure  results  in  a  workload  level  above  maximum  capability,  system 
design  changes  are  made  to  either  reduce  the  total  workload,  or  decrease 
the  probability  of  occurrence  of  the  particular  failure  mode  in  question. 

The  value  of  this  process,  in  one  particular  case,  is  demonstrated  in 
Reference  7  where  the  manhours  Invested  In  the  application  of  the  PCI 
process  would  be  "recovered"  through  flight  safety  improvements  in  8.8 
aircraft  flight  hours. 

The  above  methods  of  system  analysis  that  require  some  measure  of 
workload,  or  a  related  parameter,  are  for  the  moot  part  theoretical 
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in  P»tur*.  Hw*v»r*  within  the  present  stAts-of-the-art  these  approaches 

* 

Q«n  be  Applied  only  to  relAtively  simple,  though  perhepe  important, 
cesaa.  On  the  other  hand,  the  complexities  of  modern  flight  vehieleo 
dictAtA  the  ueo  of  simulator*  so  both  system  analysis  tools  And  experi- 
nAntAl  devices  to  validate  the  more  theoretical  approaches. 

When  simulation  is  used  as  a  system  analysis  tool,  the  concepts 
of  workloading  nay  be  more  implicit  chan  analytical  approaches,  but 
nonetheless  they  are  still  present*  For  example,  when  a  multi-task 
mission  phase  is  simulated,  the  "full  workload"  point  is  reached,  or 
exceeded,  when  the  subject  cannot  cope  with  the  multitude  of  duties  he 
is  supposed  to  perform.  Complete  simulations  should,  therefore, 
include  all  task  loadings  including  those  related  to  stability  and 
control  as  well  as  navigation,  communication ,  and  other  functions.  Under 
less  severe  conditions,  simulation  studies  can  still  yield,  or  utilize, 
a  measure  of  workload  in  the  form  of  pilot  rating  to  evaluate  various 
alternative  designs.  This  measure,  related  to  workload  (as  discussed 
later),  can  be  used  in  many  multi-task  situations,  and  with  suitable 
rating  procedures,  quantitative  as  well  as  qualitative  results  can  be 
obtained. 

In  summary,  workload  or  a  related  measure  plays  an  Important  role 
in  a  number  of  system  analysis  methods.  Tito  terminology  in  each  case 
might  be  quite  different,  but  a  broad  interpretation  of  "workload"  is 
applicable  in  each  Instance. 
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Workload  Prediction  and  Manual  Consol  Theory 

Over  the  past  decsds,  «  rather  e*ten*ive  body  o f  liceretu re  releiiag 
no  iMnual  control  theory  ha*  been  produced  (♦.  g.  Reference  6).  In  fact, 
bibliogrephie*  are  available  In  the  area  (Reference  9),  Therefore*  no 
attempt  will  be  made  here  to  summarize  the  current  etetua.  In* teed, 
only  the  relationship  between  current  theory  and  pilot  workload  pre» 
diction  will  be  considered. 

For  a  single  compensatory  tracking  task  (ace  Figure  4)  axis ting 
thoory  is  quite  adequate  to  predict  an  operator's  ability  to  control 
linear  systems  with  random  appearing  input*.  That  is,  the  limit  of  the 
operator's  capability  can  bo  fairly  accurately  predicted.  In  term*  of 
workload  this  represents  tha  "full  workload"  case.  On  the  other  hand, 
the  current  theory  cannot  accurately  prodict  a  "workload"  measure  in  the 
"gray"  area  where  control  is  possible  but  of  varying  "difficulty".  Within 
this  gray  area  pilot  opinion  ratings  have  been,  end  are  being,  need  a* 
a  meaeure  of  task  difficulty, 

Reference  7  contains  an  interesting  correletion  of  pilot  opinion 
ratings  and  workload  measured  with  a  side-task.  Although  the  population 
size  of  the  data  presented  is  small,  very  good  correlation  is  indicated. 
This  encoureging  result  suggest*  thet  if  pilot  opinion  rating*  could  b* 
predicted  from  human  response  theory*  one  could  in  turn  predict  a  work* 
load  level  for  e  given  teek,  A  current  V.8*  Air  Force  epeneored  research 
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program,  inveatigating  tha  tie  between  pilot  opinion  racing*  and 
mathematical  nodal*  of  the  human  operator  in  specific  tasks,  nay  reoolvs 
this  problem. 

It  should  be  emphaeited*  however,  that  predicting  pilot  workload, 
or  some  related  measure,  for  a  single  task,  is  only  part  of  the  overall 
problem.  To  use  this  information  in  system  design  as  discussed  above, 
the  "additive"  effects  of  oavoral  tasks  must  also  be  predicted.  Title 
is  by  no  means  easy.  For  example,  the  "additive"  properties  of  pilot 
opinion  ratings  in  multiple  tauk  situations  (Reference  10)  are  relatively 
unknown.  However,  the  results  of  recent  attempts  (e.g.  Reference  11)  to 
define  mathematical  models  of  the  human  operator  lu  multi-axis  tracking 
teaks  may,  again,  provide  the  answer  if  pilot  opinion  ratings  can 
be  predicted  from  the  resulting  modelo. 

All  of  the  above  discussion  concerns  compensatory  tracking  tasks, 

It  is  seen  that  even  in  this  area,  where  probably  the  most  useful  and 
extensive  body  of  human  response  theory  exists  for  flight  control 
applications,  the  prediction  of  workload  or  a  related  measure  still 
poses  a  problem  Because  of  this  fact,  it  ia  not  surprising  that  the 

situation  is  ev*.  worse  with  respect  to  other  piloting  tasks,  or  com¬ 
binations  of  tasko.  Hits  is,  in  fact,  the  reason  why  experimental 
simulation  procedures  are  the  most  popular  form  of  workload  measurement 
technique  at  the  present  time. 

Although  e  truly  useful  overall  mathematical  modal  of  the  human 
operator  is  a  long  way  off  at  this  time,  attempts  are  being  made  to 
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formulate  such  a  model.  In  this  respect,  certain  human  "subsystems"  such 
as  Clio  eye  mvomene  servo  and  the  hand  control  system  (e.g.  Reference* 

12  and  13)  have  been  investigated  and  mathematical  models  formulated* 

Theoo  "subayotom"  roodols  vary  in  complexity,  but  Figure  5  taken  from 
Raferenco  12  is  a  typical  taproaontaCicm,  It  cornea  as  no  surprise  that 
Flyura  6  ojcpnndod  to  Include  all  of  the  human  Operator  subsystems 
Important  to  piloting  tasks  would  roproeont  on  extremely  complex 
representation  of  the  known  complex  human  operator*  Yet*  each  eub" 
eyotcra,  and  combination  of  subsystems,  affects  the  overall  workload  of 
the  human  operator  in  a  given  task  to  some  extant * 

Some  of  the  more  recent  attompto  to  provide  broader  module  of 
tho  human  operator  are  reported  in  Reference©  14,  15  4  16.  In  Reference 
14,  Krendcl  and  McUuor  propose  a  "Succeoeivo  Organization  of  Perception” 
(,'jOP)  modol  of  tho  human  operator  in  cracking  taaka  chat  accounts  for 
various  methoda,  or  modes,  of  control  Involved  in  skill  development. 

Voooiue,  in  Rafaranco  15,  discusses  eye  and  hand  models*  and  Voseius 
is  currently  considering  an  integrated  model  of  visual  perception*  hand 
control,  and  alternate  modo©  of  control  along  the  80?  lines.  Finally, 
Senders,  Elkiud,  and  Smallwood  in  Reference  16  have  proposed  *  visual 
sampling  model  that  perhaps  can  be  used  in  tracking  as  wsll  as  monitoring 
tasks.  Each  of  the  above  davelopmant*  represents  an  extension  or  expansion 
of  simpler  "subsystem"  models  toward  a  broader  picture  of  the  human 
operator, 
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In  summary ,  manual  control  theory  shows  promise  as  a  means  to 
predict  workload  for,  at  least,  certain  combinations  of  piloting  tasks. 

In  addition,  continued  advances  in  the  physiology  of  human  subsystems 
may  provide  even  more  refined  methods  for  more  complex  tasks.  However, 
at  the  present  time  experimental  simulator  measurements,  on  an  ad  hoc 
basis,  represent  the  most  practical  means  to  determine  pilot  workload 
in  complicated  flight  control  tasks. 

Measures  of  Pilot  Work  Load 

Figure  6  taken  from  Reference  17,  presents  a  view  of  the  factors 
involved  in  physiological  measurements.  The  subject  reacts  to  the  various 
input  factors  which  include  the  sustaining  and  aenaory  factors  shown.  In 
addition  the  subject  reacts  to  psychological  factors  that  are  regenerated 
within  himself  from  stored  past  experience.  This  is  Indicated  by  what 
is  termed  in  this  reference,  the  re-entrant  loop.  These  are  the 
factors  of  anxiety,  fatigue,  stress,  the  reflex,  inherent,  and  learned 
behavior  patterns,  motivation,  attitude,  etc.  The  subject's  output  is 
divided  into  two  basic  classes,  physiological  and  psychological  with  an 
intermediate  or  "gray"  area  in  between.  The  division  into  classes  does 
not  occur  neatly  since  it  ia  known  to  laymen  as  well  as  physiologists 
that  the  body  reacts  to  etress  in  many  ways.  An  arouaad  individual’s 
heart  pounds,  stomach  contracts,  bladder  relaxes,  adrenalin  inersssss, 
pupils  dilate,  etc.  These  affects  illustrate  the  complexity  of  the  feed¬ 
backs  within  the  human.  However,  for  the  purpose  of  normal  measurement  of 
pilot  workload  this  strictly  physiological  class  has  not  and  is  not  expected 
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Co  be  particularly  helpful.  This  includes  such  measures  as  heart 
activity,  electro-cardiograms,  blood  pressure  and  flow  measurements , 
respiration,  and  metabolism  measurements. 

The  normal  pychological  measures  relate  to  operator  behavior. 

One  of  the  normal  measures  is  that  of  performance  in  a  tracking  or 
problem  solving  task  where  a  scoring  system  is  devised.  This  scoring 
ought  be  based  on  time  on  target,  rms  error,  etc.  Psychological 
experiments  are  usually  run  with  large  number  of  subjects  with  the  tasks 
planned  so  as  to  allow  statistical  analysis  techniques  to  be  applied. 
Side  tasks  along  with  the  primary  task  have  been  used  in  a  number  of 
cases.  The  idea  is  to  consider  a  reduction  in  side  task  performance  as 
an  indication  of  an  increase  in  primal,  task  difficulty.  These  cide 
tasks  might  be  flashing  lights  or  horns  Co  be  turned  off  at  intervals 
or  simple  arithmetic  or  other  problems  to  be  solved.  Eye  motion  studies 
have  been  used  in  a  number  of  display  oriented  studies  to  determine 
the  areas  of  concern  to  the  pilot,  the  time  spent  on  a  particular 
instrument,  and  the  links  between  various  Instruments,  Psychologists 
also  use  questionnaires  although  they  have  been  suspicious  of  and 
generally  have  avoided  ratings  scales. 

The  handling  qualities  engineer  has  placed  less  reliance  on 
performance  in  his  situation  or  flight  tests.  Measures  such  as  average 
clearance  in  terrain  flying,  miss  distance,  or  average  error  in 
tracking  a  target,  of  course,  would  be  used  where  such  criteria  were 
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meaningful.  This  attitude  towards  las*  reliance  on  performance  spring* 
from  hi*  knowledge  of  the  wide  adaptability  of  the  pilot  to  keep  hi* 
performance  constant  in  spite  of  varying  degrees  of  difficulty  of  the 
task.  He  has  tended  to  place  his  reliance  on  pilot  opinion  ratings. 
Furthermore,  he  has  tended  to  avoid  the  use  of  large  numbers  of  subjects, 
for  cost  reasons  partially,  but  also  because  of  a  prefe.'^nce  or  a 
greater  confidence  in  the  results  from  a  "calibrated"  test  pilot.  This 
reliance  on  a  small,  especially  selected  statistical  sample  of  subjects 
has  spawned  a  running  argument  between  psychologists  and  engineers  over 
the  validity  of  each  other's  data.  The  engineer  has  begun  to  put 
reliance,  for  specialized  problem  evaluation  at  least,  on  analyses  of 
the  pilot  vehicle  combination  by  means  of  describing  function  data  on 
the  human  pilot.  This  has  been  touched  on  previously  in  this  paper. 

Between  the  strict  physiological  class  of  measures  and  the  psycho** 
logical  class  is  the  so  called  intermediate  class.  Included  in  this 
■class  are  a  number  of  measurements  that  are  interesting  to  physiologists 
•but  also  may  be  of  use  to  the  psychologist  and  the  engineer.  To  this 
■  date,  however,  they  have  been  of  little  use  to  the  handling  qualities 
engineer.  One  of  these  measures  is  the  electrical  potential*  in  ths 
nervous  system  or  the  muscles.  The  electrical  activity  of  the  breln 
can  be  detected  with  electrodes  and  thla  Is  referred  to  a*  electro* 
encephalography,  The  highly  amplified  records  are  called  ISO's. 

These  record*  are  complex  and  by  no  mean*  fully  understood,  Although 
not  completely  reliable  «*  yet,  important  behavioral  pattern*  euoh  ** 
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*  aubj set's  tut*  of  slsrtnsss  and  vhathar  hla  ayaa  art  op  an  or  ahut  can 
ba  monitored. 

Whan  Individual  auaelaa  contract  fehay  exhibit  potential  changes 
'  that  can  ba  neaaured.  Thia  la  referred  to  aa  eleetroayography  and  the 
records  ere  called  EMG'e.  These  records  cen  Indicate  the  state  of 
synchronism  of  body  patterns  and  may  be  used  to  show  ths  presence  of 
fatigue.  Some  consideration  has  been  given  to  the  use  of  myoelectric 
signals  for  certain  control  system  applications. 

Also  of  the  same  type  are  measurements  of  the  heart's  activity 
(ECC)  which  has  been  referred  to  previously  under  the  strictly 
physiological  class  of  measurements. 

Another  general  technique,  referred  to  es  galvanic  skin  response, 
(GSR) ,  involves  measurement  of  the  resistance  between  two  electrodes  on 
the  skin  to  the  passage  of  a  small  current.  This  resistance  is  affected* 
by  the  action  of  the  near  surface  capillaries  and  the  sweat  glende, 
which  of  course  are  responsive  to  the  nervous  system.  This  measurement 
has  potential  usefulness  as  an  index  of  a  number  of  psychological  states, 
'  degree  of  alertness,  apprehension,  fear,  panic,  and  placidity.  The 
system  has  its  problems  both  in  obtaining  rallabla  signals  and  than  in 
sorting  these  signals  out,  but  to  date  this  measurement  has  been  the 
best  measurement  available  for  determining  the  peychophysiologleal 
performance  of  e  subject. 

Aa  noted  previously,  dilation  or  constriction  of  pupils  as  a 
raeult  of  strass  had  basn  notad  by  tha  physiologists  but  little  investi¬ 
gation  or  use  has  basn  mads  of  ths  phsnoosnon.  In  Refer sues  16,  Dt. 
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Kokhard  Hess  presents  some  very  interesting  observations  of  the  reactions 
of  the  pupils  to  interest,  emotions,  attitude,  and  thought  processes. 

Figure  7  shove  evereged  increases  in  pupil  site  for  five  subjects 
performing  mental  multiplications  of  varying  difficulty.  Or,  Hess 
refers  to  the  eye  as  an  extension  of  the  brain,  embryologlcally  and 
anatomically,  and  furthermore,  an  extension  that  is  in  plain  sight  for 
the  psychologist  or  engineer  to  peer  ot.  Intuitively,  it  is  felt  that 
the  possibilities  of  a  useful  measure  of  pilot  workload  are  higher  in 
this  case,  than  for  such  measures  as  EEG  or  GSR  where  measurement  problems, 
confusion  in  signals,  and  involved  feedback  loops  are  Involved,  Stimu¬ 
lated  by  Dr.  Hess' 9  work,  which  was  not  concerned  with  piloting  or 
tracking  situations,  a  preliminary  experiment  was  performed  to  determine 
whether  pupilometrics  offered  a  measure  of  workload  that  we  engineers  and 
psychologists  could  use.  The  experiment  and  its  general  results  are 
described  below. 


Pup.il  Dilation  Experiments 

The  main  objectives  of  the  experimental  program  were!  s.  to 
determine  if  pupil  size  variations  (similar  to  those  reported  in 
Reference  18)  exist  when  tracking  tasks  of  varying  difficulty  are  per¬ 
formed,  and  b.  to  determine  how  these  variations,  if  any,  are  correlated 
with  task  "difficulty"  and  "conventional"  workload  measurements. 

To  accomplish  these  objectives  a  low  order,  but  difficult,  manual 
tracking  task  v.-Un  an  unstable  first  order  controlled  element  was 
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simulated.  The  subject's  eye  was  photographed  using  available  artificial 
light  and  u  16mm.  motion  picture  camera.  Strip  chart  recordings  of 
appropriate  signals  were  made  at  the  some  time.  To  synchronize  the  eye 
data  with  the  9trip  chart  recordings,  the  camera  photographed  the  eub>» 
jecc's  eye  along  with  a  small  voltmeter  that  displayed  a  measure  of 
cask  difficulty  and  computer  start  and  3 top  signals.  A  secondary  aide** 
task  was  also  implemented  on  Che  same  analog  computer  used  to  simulate 
the  controlled  element  dynamics.  This  side-task  was  used  to  provide  t 
"conventional"  measure  of  workload.  The  two  tasks  are  described  below: 

Tracking  Task:  Representing  the  pilot's  input  stick  deflection  by 
c,  and  the  controlled  element  output  by  m,  the  controlled  element  differ¬ 
ential  equation  was  4^  -  Am  «  Xc,  where  —  »  time  derivative  of  m(t). 

at  dt 

The  value  of  X,  in  rad/sec,  controls  the  degree  or  "difficulty"  of  the 
tracking  task,  and  the  value  could  be  held  constant  or  varied  os  a 
f  ction  of  time.  In  the  latter  case,  the  parameter  X  varied  at  a  rate 
of  .10  rad/sec2  from  an  initial  3.0  value  until  the  tracking  error  (-m) 
on  the  oscilloscope  display  reached  a  value  of  +  2  cm.  At  this  point, 
the  X  rate  was  switched  to  a  value  of  .025  rad/sec2  until  control  was 
lost  (first  time  an  error  of  +  7  cm  on  the  scope  was  reached).  The  subject 
could  see  a  region  of  about  ±  6  cm.  on  the  scope.  The  time-varying  case 
is  called  a  "critical"  ta6k  in  Reference  2,  and  the  minimum  value  of  i 
reached  by  the  subject  ia  a  good  measure  of  his  effective  reaction  time 
delay  in  this  tracking  task.  In  the  present  case,  however,’  the  task 
served  as  a  "rarup"  loading  t  at  pushed  the  subject  to  his  limits  (full 
workload) . 


A 
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The  tracking  error  (~o)  vas  displayed  to  the  subject  as  a  horizontally 
moving  dot  on  the  display,  and  control  was  achieved  by  moving  a  vertically 
mountad  sida-stick  controller  with  a  le£t-to-right  wriet  motion.  Th* 
controlled  element  had  no  external  input,  and  therefore  the  system  output 
was  a  result  of  pilot  actions  only.  In  all  cases  the  subject  was  told 
to  keep  the  dot  centered  on  the  scope  with  a  minimum  of  error. 

Side-Tack:  The  side-task  used  was  a  version  of  thoc  described  in 
Reference  7  for  ''conventional"  workload  measurements.  This  task  consisted 
of  centering  a  horizontal  line  on  a  uocond  display  scope  adjacent  to  the 
tracking  task  display  scope.  A  random  noise  source  triggered  the  "line" 
from  a  zero  setting  to  a  plus  (up)  or  minus  (down)  position  in  a  random 
fashion  at  an  average  rate  of  about  3.25  seconds  between  inputs.  The 
subject  used  a  three  position  trim  BWitch  in  his  left  hand  to  generate 
a  pulse  that  would  return  the  "line"  to  zero.  Once  triggered  by  the 
random  noise,  the  line  would  hold  the  off-zero  setting  until  the  subject 
responded.'  The  absolute  value  of  the  displayed  signal  was  integrated 
over  time,  and  a  "score"  (T)  was  obtained  as  the  integrated  value  divided 
by  the  product  of  the  number  of  random  triggering  signals  that  occurred 
during  a  given  run  and  the  offset  voltage  value.  The  measured  score  was, 
therefore,  proportional  to  the  subject's  average  time  delay  in  responding 
to  the  side-cask.  During  experiments  with  the  subject  operating  both 
the  tracking  task  and  the  side-task,  the  subject  was  told  to  give  the 
tracking  task  the  highest  priority,  and  respond  to  the  side-task  only 
when  possible. 
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The  specific  experiments  performed  constated  of  four  classes s 

1.  Time-very ing  X  tree king. 

2.  fixed  X  tracking  (various  X  values)* 

3.  Fixed  X  tracking  with  aide-task. 

4.  Error  observation  only,  no  other  tasks. 

The  latter  wr  3  accomplished  by  recording  the  tracking  error  during 
experiments  in  the  first  and  second  classes  with  on  FM  tape  recorder, 
and  then  reproducing  the  output  for  the  same  subject  to  observe.  Photo¬ 
graphs  were  taken  in  each  case.  For  each  class  the  general  experimental 
arrangement  is  shown  in  Figure  8, 

Although  several  subjects  have  participated  in  the  experiments  made 
to  data,  tha  results  presented  here  were  obtained  with  a  single  subject. 
This  subject,  a  rated  pilot,  ha3  a  nominal  amount  of  experience  with 
tracking  tasks  and  simulators  in  general,  and  a  fair  amount  of  experience 
with  the  tracking  task  used  here.  In  the  latter  experiments  reported, 
he  obtained  time-varying  X  values  of  about  6.5  rad/oec  which  approached 
the  values  of  very  experienced  subjects  as  reported  in  Reference  2. 

Perhaps  the  most  dramatic  results  of  the  experiments  are  shown  in 
Figure  9  where  error,  X,  and  eye  variations  in  the  form  of  pupil  diameter 
to  iris  diameter  ratios  (R)  are  given  for  a  time-varying  X  experiment 
(Class  1).  In  addition,  R  values  for  constant  X'e  (Class  2)  are  super¬ 
imposed,  using  the  symbol w(  on  the  R  plot  at  the  time  point  corresponding 
to  each  X.  Figure  9  indicates  a  large  variation  in  R  (about  36%)  over 
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tha  46  second  run.  Furthermore,  the  R  variation  le  seen  to  exhibit  a 
steady  increase  with  increased  X  (ix^creaeingly  more  "difficult"  task)  as 
veil  as  rapid  increases  that  are  directly  correlated  with  the  envelop* 
of  error.  That  is,  R  increases  (pupil  dilation)  with  large  error 
excursions  at  points  in  the  run  where  the  subject  almost  loses  control. 
Finally,  the  constant  X  valuoo  of  R  (from  data  recorded  shortly  before 
the  time-varying  run  shown)  evidence  the  same  general  steady  increase, 
in  R  up  to  a  X  value  of  about  5.2  rod/eoc.  The  fluctuations  in  the  R 
data,  with  about  a  two  second  period,  may  be  duo  to  measurement  errors 
in  reducing  the  camera  data  (data  points  taken  at  about  one  second 
intervals).  Or,  these  variations  may  be  "unrest"  fluctuations  of  tho 
type  reported  in  Reference.  19. 

The  results  of  a  series  of  Class  3  runs  ore  compared  with  eye 
measurements  from  a  series  of  Class  ?.  runo  for  the  same  fixed  values 
of  X  in  Figure  10. 

The  data  are  average  values  for  one  30  second  tracking  task  run, 
and  two  60  second  tracking  plus  side-task  runs  for  each  X.  The 
workload  meaourement,  T,  increases  as  the  primary  tracking  task  becomes 
more  difficult  (\  increases).  Above  a  \  value  of  4.9  rad/sec,  a  leveling 
off  and  scatter  is  obsovved  in  the  data.  This  may  be  due  to  nonlinear 
variations  with  X,  or  perhaps  training  effects  are  involved.  At  any 
rate,  the  R  variation  with  \  is  much  the  same  as  the  T  variation 
indicating  a  direct  correlation  of  increased  "conventional"  workload  with 
pupil  dilation.  Above  X  •  5.5  rad/eec  values,  however,  the  data  do  not 
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show  similar  trends  in  R  and  T.  Again  training  effects  may  be  evident » 
or  the  email  data  population  may  be  the  answer  to  title  difference . 

In  an  attempt  to  determine  if  the  pupil  ■  _ationa  observed  were  the 
direct  results  of  observing  the  display  only,  and  not  unique  to  the 
combined  observation-control  task,  a  limited  Amount  of  data  Was  collected 
from  Class  4  experiments.  Figure  11  shows  data  from  the  last  20  seconds 
of  a  time-varying  X  experiment  in  the  form  of  R  values  during  actual  . 
tracking,  and  when  the  subject  io  simply  observing  the  soma  error  signal, 

A  difference  in  the  R  values  at  coincident  times  is  evident  up  to  the 
last  few  seconds  of  the  experiment.  Film  records  aloo  indicated  much 
more  eye  blinking,  and  soma  eye  tracking,  in  the:  monitoring  record.  The 
tracking  record  3howod  a  steady  "scare".  It  should  bo  noted,  however, 
that  a  higher  speed,  and  grainy,  film  used  in  the  run  shown  caused  data 
reduction  problems  and  associated  scatter  in  the  data. 

Finally,  a  number  of  Class  1  experiments  with  a  variety  of  sub j acta 
with  very  little  training  showed  a  quite  universal  effect,  with  R  ratio 
increases  from  near  zero  to  20%  over  the  time-varying  X  runs. 

Although  the  experiments  reported  hero  arc  certainly  preliminary, 
the  main  objectives  were  met,  and  the  following  tentative  conclusions 
can  be  drawn: 

a.  Fupil  dilation  is  evident  in  certain  manual  tracking  tasks  of 
increasing  "difficulty'' . 

b.  This  dilation  is  correlated  with  the  results  of  at  least  one, 
mote  or  lees  conventional,  workload  measurement  technique,  and  is  also 
correlated  with  task  "difficulty". 
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c.  The  exact  cause  of  this  effect  is  unknown,  but  it  docs  not 
Appear  to  be  the  sole  result  of  error  observation.  That  it,  the  phenomenon 

a 

appears  to  he  a  result  of  stresses  from  tho  combined  oboetvation-oontrol 
tosh. 

Much  remains  to  bo  done  before  pupil  a:l«o  variations  can  be  used 
with  confidence  as  a  manual  control  workload  measurement  technique,  but 
the  preliminary  results  reported  hero  arc  encouraging.  Furthermore,  Che 
advantages  of  the  method,  if  verified  by  further  work,  ovor  side-task 
methods  are  clear  with  respect  to  rapid  response,  tho  degree  of  subject 
distraction  from  tho  main  task,  and  tho  possibility  of  electronic  on-line 
data  reduction  (o.g.  Pupilomctor  of  Reference  19). 


Conclusions  and  Recommendations 

Xn  conclusion  it  can  bo  said,  without  fear  of  contradiction,  that 
there  is  a  real  need  for  consideration  of  workload  in  setting  tho  require¬ 
ments  for  and  specifications  of  pilot  related  aircraft  parameters.  Once 
available,  quantitative  measures  of  workload  would  play  a  very  important 


1*0 lc  in  the  design  of  the 


tir craft  and  its  flight  control  system. 


benefits  would  bo  real  and  important. 

It  has  been  pointed  out  chat  there  ara  a  number  of  methods  to  measure 
eomo  workload  related  parameters,  none  of  which  have  been  very  generally 
useful  or  widely  applied.  Human  response  theory  and  physiology  develop*- 
meats  may  provide  mechodo  to  predict  work  loading  for  certain  control 
related  tasks;  however,  at  present,  experimental  simulation  procedures 


are  the  most  useful. 
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A  now  workload  related  measurement  technique,  baaed  on  pupil 
dilation,  la  shown  to  have  some  promise  from  preliminary  experiments. 

The  method  is  applicable  to  flight  control  tasks,  provides  tepid 
response,  and  presents  no  subject  distraction.  Additional,  more  extensive, 
end  more  carefully  plonnod  experiments  are  definitely  in  order  to 
explore  the  possibilities. 

There  io  no  question  but  that  the  handling  qualities  engineer  should 
broaden  hio  ideas  of  workload  and  make  a  concentrated  effort  to  apply 
the  ideas  and  measurement  tools  of  the  physiologist  and  cho  psychologist 
to  tho<  quantitative  measurement  of  workload,  'flic  need  is  clear  and  the 
possibilities  are  apparent.  The  time  is  opportune  for  those  in  research 
to  take  action. 
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Figure  2  Typical  Time  Line  Task  Assignment 


figure  3  Phases  of  PCI  Process 


Diagram  Of  Ztie  Control  System  For  Hand  Movement 
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Figure  6  Footer*  Involved  in  Physiological  Measurements 
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Correlation  of  Workload  and  Pupil  Dilation 
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Figure  11  Pupil  Variations  in  Tracking  Vs.  Error  Observation 


